2026-10-26 12:38:23,170 [ 273849 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:42, check_args_and_update_paths) 2026-10-26 12:38:23,170 [ 273849 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:86, check_args_and_update_paths) 2026-10-26 12:38:23,171 [ 273849 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:97, check_args_and_update_paths) 2026-10-26 12:38:23,171 [ 273849 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:99, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_asrp3k --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update 'test_storage_s3_queue/test.py::test_delete_after_processing[ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered]' test_storage_s3_queue/test.py::test_drop_table 'test_storage_s3_queue/test.py::test_failed_retry[ordered]' 'test_storage_s3_queue/test.py::test_failed_retry[unordered]' test_storage_s3_queue/test.py::test_max_set_age test_storage_s3_queue/test.py::test_max_set_size test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered]' 'test_storage_s3_queue/test.py::test_processed_file_setting[1]' 'test_storage_s3_queue/test.py::test_processed_file_setting[5]' 'test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1]' -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: order-1.0.1, random-0.2, timeout-2.2.0, repeat-0.9.3, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_storage_redis/test.py::test_create_table test_storage_s3_queue/test.py::test_delete_after_processing[ordered] test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] test_storage_hudi/test.py::test_multiple_hudi_files test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_reloading_storage_configuration/test.py::test_add_disk test_rocksdb_options/test.py::test_invalid_block_based_table_options test_session_log/test.py::test_grpc_session test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy [gw6] [ 1%] PASSED test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session [gw6] [ 2%] PASSED test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions [gw6] [ 3%] PASSED test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session [gw2] [ 4%] PASSED test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy [gw3] [ 5%] PASSED test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options [gw0] [ 6%] PASSED test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with [gw5] [ 7%] PASSED test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete [gw6] [ 8%] PASSED test_session_log/test.py::test_postgres_session [gw5] [ 9%] PASSED test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_row_policy/test.py::test_change_of_users_xml_changes_row_policies [gw5] [ 10%] PASSED test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert [gw5] [ 11%] PASSED test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select [gw5] [ 12%] PASSED test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate [gw2] [ 13%] PASSED test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config [gw5] [ 14%] PASSED test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update [gw5] [ 15%] PASSED test_storage_redis/test.py::test_update [gw3] [ 16%] PASSED test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_reload_query_masking_rules/test.py::test_reload_query_masking_rules [gw0] [ 17%] PASSED test_row_policy/test.py::test_change_of_users_xml_changes_row_policies [gw2] [ 18%] PASSED test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_row_policy/test.py::test_dcl_introspection [gw2] [ 19%] PASSED test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy [gw0] [ 20%] PASSED test_row_policy/test.py::test_dcl_introspection [gw3] [ 21%] PASSED test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_recovery_replica/test.py::test_update_metadata test_row_policy/test.py::test_dcl_management [gw2] [ 22%] PASSED test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works [gw5] [ 23%] PASSED test_reload_query_masking_rules/test.py::test_reload_query_masking_rules [gw0] [ 24%] PASSED test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml [gw0] [ 25%] PASSED test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_reload_zookeeper/test.py::test_reload_zookeeper [gw2] [ 26%] PASSED test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_row_policy/test.py::test_grant_create_row_policy [gw3] [ 27%] PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options [gw0] [ 28%] PASSED test_row_policy/test.py::test_grant_create_row_policy [gw2] [ 29%] PASSED test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_row_policy/test.py::test_introspection [gw0] [ 30%] PASSED test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join [gw0] [ 31%] PASSED test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines [gw3] [ 32%] PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options [gw2] [ 33%] PASSED test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy [gw0] [ 34%] PASSED test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned [gw0] [ 35%] PASSED test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned [gw2] [ 36%] PASSED test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_row_policy/test.py::test_policy_on_distributed_table_via_role [gw0] [ 37%] PASSED test_row_policy/test.py::test_policy_on_distributed_table_via_role [gw5] [ 38%] PASSED test_reload_zookeeper/test.py::test_reload_zookeeper test_row_policy/test.py::test_reload_users_xml_by_timer [gw3] [ 39%] PASSED test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options [gw3] [ 40%] PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options [gw3] [ 41%] PASSED test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options [gw3] [ 42%] PASSED test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options [gw2] [ 43%] PASSED test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk [gw3] [ 44%] PASSED test_rocksdb_options/test.py::test_valid_options test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage [gw0] [ 45%] PASSED test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery [gw2] [ 46%] PASSED test_reloading_storage_configuration/test.py::test_update_disk [gw0] [ 47%] PASSED test_row_policy/test.py::test_row_policy_filter_with_subquery test_replace_partition/test.py::test_normal_work test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_row_policy/test.py::test_smoke [gw6] [ 48%] PASSED test_recovery_replica/test.py::test_update_metadata [gw0] [ 49%] PASSED test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies [gw0] [ 50%] PASSED test_row_policy/test.py::test_some_users_without_policies test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_row_policy/test.py::test_tags_with_db_and_table_names [gw0] [ 51%] PASSED test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter [gw0] [ 52%] PASSED test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter [gw0] [ 53%] PASSED test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data [gw6] [ 54%] PASSED test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop [gw2] [ 55%] PASSED test_replication_without_zookeeper/test.py::test_startup_without_zookeeper [gw0] [ 56%] PASSED test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data [gw5] [ 57%] PASSED test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data [gw0] [ 58%] PASSED test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl [gw0] [ 59%] PASSED test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere [gw6] [ 60%] PASSED test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings [gw0] [ 61%] PASSED test_row_policy/test.py::test_with_prewhere [gw8] [ 62%] ERROR test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file [gw8] [ 63%] ERROR test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types [gw8] [ 64%] ERROR test_storage_hudi/test.py::test_types [gw7] [ 65%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list [gw7] [ 66%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy [gw7] [ 67%] ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy [gw9] [ 68%] ERROR test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns [gw9] [ 69%] ERROR test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_settings_constraints_distributed/test.py::test_insert_clamps_settings [gw1] [ 70%] ERROR test_storage_s3_queue/test.py::test_delete_after_processing[ordered] test_storage_s3_queue/test.py::test_delete_after_processing[unordered] [gw1] [ 71%] ERROR test_storage_s3_queue/test.py::test_delete_after_processing[unordered] test_storage_s3_queue/test.py::test_direct_select_file[ordered] [gw1] [ 72%] ERROR test_storage_s3_queue/test.py::test_direct_select_file[ordered] test_storage_s3_queue/test.py::test_direct_select_file[unordered] [gw1] [ 73%] ERROR test_storage_s3_queue/test.py::test_direct_select_file[unordered] test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered] [gw9] [ 74%] PASSED test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings [gw1] [ 75%] ERROR test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered] test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered] [gw1] [ 76%] ERROR test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered] test_storage_s3_queue/test.py::test_drop_table [gw1] [ 77%] ERROR test_storage_s3_queue/test.py::test_drop_table test_storage_s3_queue/test.py::test_failed_retry[ordered] [gw1] [ 78%] ERROR test_storage_s3_queue/test.py::test_failed_retry[ordered] test_storage_s3_queue/test.py::test_failed_retry[unordered] [gw1] [ 79%] ERROR test_storage_s3_queue/test.py::test_failed_retry[unordered] test_storage_s3_queue/test.py::test_max_set_age [gw1] [ 80%] ERROR test_storage_s3_queue/test.py::test_max_set_age test_storage_s3_queue/test.py::test_max_set_size [gw1] [ 81%] ERROR test_storage_s3_queue/test.py::test_max_set_size test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch [gw1] [ 82%] ERROR test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered] [gw1] [ 83%] ERROR test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered] test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered] [gw1] [ 84%] ERROR test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered] test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered] [gw1] [ 85%] ERROR test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered] test_storage_s3_queue/test.py::test_processed_file_setting[1] [gw1] [ 86%] ERROR test_storage_s3_queue/test.py::test_processed_file_setting[1] test_storage_s3_queue/test.py::test_processed_file_setting[5] [gw1] [ 87%] ERROR test_storage_s3_queue/test.py::test_processed_file_setting[5] test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1] [gw1] [ 88%] ERROR test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1] [gw9] [ 89%] PASSED test_settings_constraints_distributed/test.py::test_select_clamps_settings [gw4] [ 90%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] [gw4] [ 91%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format [gw4] [ 92%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] [gw4] [ 93%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] [gw4] [ 94%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] [gw4] [ 95%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] [gw4] [ 96%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] [gw4] [ 97%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format [gw4] [ 98%] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format [gw3] [ 99%] ERROR test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage [gw5] [100%] ERROR test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl ==================================== ERRORS ==================================== __________________ ERROR at setup of test_multiple_hudi_files __________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): cluster = ClickHouseCluster(__file__, with_spark=True) try: cluster.add_instance( "node1", main_configs=["configs/config.d/named_collections.xml"], user_configs=["configs/users.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_hudi/test.py:59: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- 26/10/26 12:38:30 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Picked up JAVA_TOOL_OPTIONS: -Djdk.attach.allowAttachSelf=true Picked up JAVA_TOOL_OPTIONS: -Djdk.attach.allowAttachSelf=true Setting default log level to "WARN". To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:38:27 [ 482 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 482 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 482 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:38:27 [ 482 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:38:27 [ 482 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 482 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 482 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV HOSTNAME 564b9ab79d02 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV SHLVL 0 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV HOME /root (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV OLDPWD / (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG a2d3dc777d0c (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update 'test_storage_s3_queue/test.py::test_delete_after_processing[ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered]' test_storage_s3_queue/test.py::test_drop_table 'test_storage_s3_queue/test.py::test_failed_retry[ordered]' 'test_storage_s3_queue/test.py::test_failed_retry[unordered]' test_storage_s3_queue/test.py::test_max_set_age test_storage_s3_queue/test.py::test_max_set_size test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered]' 'test_storage_s3_queue/test.py::test_processed_file_setting[1]' 'test_storage_s3_queue/test.py::test_processed_file_setting[5]' 'test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1]' -vvv (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG ce74919e88f5 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV TZ Etc/UTC (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV DOCKER_BASE_TAG 2993bc2bf171 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 74e32b7315b0438db9ac9ea5764b4cde (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV PYTEST_XDIST_WORKER gw8 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : ENV PYTEST_CURRENT_TEST test_storage_hudi/test.py::test_multiple_hudi_files (setup) (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 482 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:696, __init__) 2026-10-26 12:38:30 [ 482 ] DEBUG : GatewayClient.address is deprecated and will be removed in version 1.0. Use GatewayParameters instead. (java_gateway.py:163, deprecated) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: A 2d24bfd8a9bc1c817cd6a1fd51277998b8f4087441f7db719506bf4c898c297c (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.SparkConf e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.api.java.* e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.api.python.* e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.ml.python.* e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.mllib.api.python.* e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.resource.* e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.sql.* e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.sql.api.python.* e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj org.apache.spark.sql.hive.* e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: j i rj scala.Tuple2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: r u SparkConf rj e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.SparkConf (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: i org.apache.spark.SparkConf bTrue e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro0 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 set sspark.app.name sspark_test e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro1 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 set sspark.master slocal e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro2 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 contains sspark.serializer.objectStreamReset e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 set sspark.serializer.objectStreamReset s100 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro3 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 contains sspark.rdd.compress e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 set sspark.rdd.compress sTrue e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro4 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 contains sspark.master e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 contains sspark.app.name e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 contains sspark.master e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 get sspark.master e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 contains sspark.app.name e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ybtrue (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 get sspark.app.name e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 contains sspark.home e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o0 getAll e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yto5 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a g o5 i0 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro6 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o6 _1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark.master (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o6 _2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yslocal (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a g o5 i1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro7 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o7 _1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark.app.name (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o7 _2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark_test (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a g o5 i2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o8 _1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark.rdd.compress (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o8 _2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysTrue (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a g o5 i3 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro9 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o9 _1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark.serializer.objectStreamReset (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o9 _2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ys100 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a g o5 i4 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro10 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o10 _1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark.submit.pyFiles (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o10 _2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a g o5 i5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro11 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o11 _1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark.submit.deployMode (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o11 _2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysclient (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a g o5 i6 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro12 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o12 _1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark.ui.showConsoleProgress (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o12 _2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ystrue (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a g o5 i7 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yro13 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o13 _1 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ysspark.app.submitTime (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: c o13 _2 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ys1793018309908 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: a e o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !yi8 (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: r u JavaSparkContext rj e (clientserver.py:501, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.api.java.JavaSparkContext (clientserver.py:512, send_command) 2026-10-26 12:38:30 [ 482 ] DEBUG : Command to send: i org.apache.spark.api.java.JavaSparkContext ro0 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: A 2d24bfd8a9bc1c817cd6a1fd51277998b8f4087441f7db719506bf4c898c297c (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: m d o1 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: m d o2 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: m d o3 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: m d o4 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: m d o5 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro14 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro15 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o15 conf e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro16 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u PythonAccumulatorV2 rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonAccumulatorV2 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: i org.apache.spark.api.python.PythonAccumulatorV2 s127.0.0.1 i58481 s2d24bfd8a9bc1c817cd6a1fd51277998b8f4087441f7db719506bf4c898c297c e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro17 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro18 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o18 register ro17 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils isEncryptionEnabled e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils isEncryptionEnabled ro14 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getPythonAuthSocketTimeout ro14 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yL15 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u PythonUtils rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.api.python.PythonUtils (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.api.python.PythonUtils getSparkBufferSize e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.api.python.PythonUtils getSparkBufferSize ro14 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yi65536 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache.spark.SparkFiles rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.SparkFiles (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.SparkFiles getRootDirectory e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ys/tmp/spark-ec539d6a-e821-4b81-8568-88621df9fc53/userFiles-026f4f59-0be3-4590-be58-014133be6eb2 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o16 get sspark.submit.pyFiles s e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ys (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.util.Utils getLocalDir e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro19 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o19 conf e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro20 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils getLocalDir ro20 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ys/tmp/spark-ec539d6a-e821-4b81-8568-88621df9fc53 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache.spark rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache.spark.util rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yp (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u org.apache.spark.util.Utils rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.util.Utils (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.util.Utils createTempDir e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.util.Utils createTempDir s/tmp/spark-ec539d6a-e821-4b81-8568-88621df9fc53 spyspark e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro21 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o21 getAbsolutePath e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ys/tmp/spark-ec539d6a-e821-4b81-8568-88621df9fc53/pyspark-2ef1175d-a0a7-46e7-82af-a52da480d600 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o16 get sspark.python.profile sfalse e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ysfalse (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession getDefaultSession e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro22 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o22 isDefined e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ybfalse (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o14 sc e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro23 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: i java.util.HashMap e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yao24 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o24 put sspark.app.name sspark_test e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o24 put sspark.master slocal e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yn (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: i org.apache.spark.sql.SparkSession ro23 ro24 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yro25 (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setDefaultSession e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setDefaultSession ro25 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession setActiveSession e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession setActiveSession ro25 e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c o14 stop e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession clearDefaultSession e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession clearDefaultSession e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r u SparkSession rj e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ycorg.apache.spark.sql.SparkSession (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: r m org.apache.spark.sql.SparkSession clearActiveSession e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !ym (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Command to send: c z:org.apache.spark.sql.SparkSession clearActiveSession e (clientserver.py:501, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:31 [ 482 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:31 [ 482 ] DEBUG : Cluster name: project_name:rootteststoragehudi. Added instance name:node1 tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:31 [ 482 ] INFO : Starting cluster... (test.py:58, started_cluster) 2026-10-26 12:38:31 [ 482 ] INFO : Running tests in /ClickHouse/tests/integration/test_storage_hudi/test.py (cluster.py:2659, start) 2026-10-26 12:38:31 [ 482 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:38:31 [ 482 ] DEBUG : Docker networks for project rootteststoragehudi are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:32 [ 482 ] DEBUG : Docker containers for project rootteststoragehudi are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o0 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o6 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o7 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o8 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o9 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o10 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o11 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o12 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o13 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o15 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o18 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command to send: m d o24 e (clientserver.py:501, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:32 [ 482 ] DEBUG : Docker volumes for project rootteststoragehudi are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:32 [ 482 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:38:32 [ 482 ] DEBUG : Docker networks for project rootteststoragehudi are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:32 [ 482 ] DEBUG : Docker containers for project rootteststoragehudi are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:32 [ 482 ] DEBUG : Docker volumes for project rootteststoragehudi are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command:docker container list --all --filter name='^/rootteststoragehudi_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:38:32 [ 482 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:38:32 [ 482 ] DEBUG : No running containers for project: rootteststoragehudi (cluster.py:829, cleanup) 2026-10-26 12:38:32 [ 482 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:38:32 [ 482 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:38:32 [ 482 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:38:32 [ 482 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:38:32 [ 482 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:32 [ 482 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:32 [ 482 ] DEBUG : Setup directory for instance: node1 (cluster.py:2679, start) 2026-10-26 12:38:32 [ 482 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:32 [ 482 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:32 [ 482 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:32 [ 482 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:32 [ 482 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_hudi/configs/config.d/named_collections.xml'] to /ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:32 [ 482 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/database (cluster.py:4488, create_dir) 2026-10-26 12:38:32 [ 482 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:32 [ 482 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:38:32 [ 482 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:38:32 [ 482 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:32 [ 482 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:32 [ 482 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:32 [ 482 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:32 [ 482 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:38:32 [ 482 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:38:33 [ 482 ] DEBUG : Command to send: m d o19 e (clientserver.py:501, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Command to send: m d o20 e (clientserver.py:501, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Command to send: m d o21 e (clientserver.py:501, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Command to send: m d o22 e (clientserver.py:501, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Command to send: m d o23 e (clientserver.py:501, send_command) 2026-10-26 12:38:33 [ 482 ] DEBUG : Answer received: !yv (clientserver.py:512, send_command) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 482 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:39:21 [ 482 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:39:21 [ 482 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 482 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:40:00 [ 482 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:40:03 [ 482 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 482 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:40:42 [ 482 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:40:48 [ 482 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 482 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:41:35 [ 482 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:41:44 [ 482 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:42:28 [ 482 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:42:28 [ 482 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:42:28 [ 482 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:42:28 [ 482 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Docker networks for project rootteststoragehudi are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:42:28 [ 482 ] DEBUG : Docker containers for project rootteststoragehudi are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:42:28 [ 482 ] DEBUG : Docker volumes for project rootteststoragehudi are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:42:28 [ 482 ] DEBUG : Command:docker container list --all --filter name='^/rootteststoragehudi_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : No running containers for project: rootteststoragehudi (cluster.py:829, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:42:28 [ 482 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:42:28 [ 482 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Docker networks for project rootteststoragehudi are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:42:28 [ 482 ] DEBUG : Docker containers for project rootteststoragehudi are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:42:28 [ 482 ] DEBUG : Docker volumes for project rootteststoragehudi are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:42:28 [ 482 ] DEBUG : Command:docker container list --all --filter name='^/rootteststoragehudi_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : No running containers for project: rootteststoragehudi (cluster.py:829, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:42:28 [ 482 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:42:28 [ 482 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ___________________ ERROR at setup of test_single_hudi_file ____________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): cluster = ClickHouseCluster(__file__, with_spark=True) try: cluster.add_instance( "node1", main_configs=["configs/config.d/named_collections.xml"], user_configs=["configs/users.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_hudi/test.py:59: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________________________ ERROR at setup of test_types _________________________ [gw8] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): cluster = ClickHouseCluster(__file__, with_spark=True) try: cluster.add_instance( "node1", main_configs=["configs/config.d/named_collections.xml"], user_configs=["configs/users.d/users.xml"], with_minio=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_hudi/test.py:59: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_s3_with_https_env_proxy ________________ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:48: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling remote_proxy_node ... E Pulling proxy_list_node ... E Pulling env_node ... E Pulling resolver ... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling remote_proxy_node ... Pulling proxy_list_node ... Pulling env_node ... Pulling resolver ... Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling env_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:38:27 [ 479 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:38:27 [ 479 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:38:27 [ 479 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV HOSTNAME 564b9ab79d02 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV SHLVL 0 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV HOME /root (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV OLDPWD / (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG a2d3dc777d0c (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update 'test_storage_s3_queue/test.py::test_delete_after_processing[ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered]' test_storage_s3_queue/test.py::test_drop_table 'test_storage_s3_queue/test.py::test_failed_retry[ordered]' 'test_storage_s3_queue/test.py::test_failed_retry[unordered]' test_storage_s3_queue/test.py::test_max_set_age test_storage_s3_queue/test.py::test_max_set_size test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered]' 'test_storage_s3_queue/test.py::test_processed_file_setting[1]' 'test_storage_s3_queue/test.py::test_processed_file_setting[5]' 'test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1]' -vvv (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG ce74919e88f5 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV TZ Etc/UTC (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV DOCKER_BASE_TAG 2993bc2bf171 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 74e32b7315b0438db9ac9ea5764b4cde (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV PYTEST_XDIST_WORKER gw7 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : ENV PYTEST_CURRENT_TEST test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy (setup) (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:696, __init__) 2026-10-26 12:38:27 [ 479 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 479 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy. Added instance name:remote_proxy_node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 479 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 479 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy. Added instance name:proxy_list_node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 479 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 479 ] DEBUG : Cluster name: project_name:roottests3tablefunctionwithhttpsproxy. Added instance name:env_node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 479 ] INFO : Starting cluster... (test.py:47, cluster) 2026-10-26 12:38:27 [ 479 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/test.py (cluster.py:2659, start) 2026-10-26 12:38:27 [ 479 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:38:27 [ 479 ] DEBUG : Docker networks for project roottests3tablefunctionwithhttpsproxy are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:27 [ 479 ] DEBUG : Docker containers for project roottests3tablefunctionwithhttpsproxy are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:27 [ 479 ] DEBUG : Docker volumes for project roottests3tablefunctionwithhttpsproxy are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:27 [ 479 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:38:27 [ 479 ] DEBUG : Docker networks for project roottests3tablefunctionwithhttpsproxy are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:27 [ 479 ] DEBUG : Docker containers for project roottests3tablefunctionwithhttpsproxy are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:27 [ 479 ] DEBUG : Docker volumes for project roottests3tablefunctionwithhttpsproxy are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:27 [ 479 ] DEBUG : Command:docker container list --all --filter name='^/roottests3tablefunctionwithhttpsproxy_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:38:27 [ 479 ] DEBUG : No running containers for project: roottests3tablefunctionwithhttpsproxy (cluster.py:829, cleanup) 2026-10-26 12:38:27 [ 479 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:38:27 [ 479 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:38:27 [ 479 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Stderr:Error response from daemon: a prune operation is already running (cluster.py:123, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:38:27 [ 479 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup directory for instance: remote_proxy_node (cluster.py:2679, start) 2026-10-26 12:38:27 [ 479 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/proxy_remote.xml', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup directory for instance: proxy_list_node (cluster.py:2679, start) 2026-10-26 12:38:27 [ 479 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/proxy_list.xml', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup directory for instance: env_node (cluster.py:2679, start) 2026-10-26 12:38:27 [ 479 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/configs/config.d/ssl.xml'] to /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 479 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/minio/certs/public.crt', 'https_proxy': 'https://proxy1'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/.env (cluster.py:86, _create_env_file) 2026-10-26 12:38:27 [ 479 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:38:27 [ 479 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:27 [ 479 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:27 [ 479 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:27 [ 479 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:27 [ 479 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:38:27 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:21 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:39:21 [ 479 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling proxy_list_node ... Pulling env_node ... Pulling remote_proxy_node ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy_list_node ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling env_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:39:21 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:00 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:40:00 [ 479 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling proxy_list_node ... Pulling env_node ... Pulling remote_proxy_node ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling env_node ... pulling from altinityinfra/integr... Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:40:03 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:53 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:40:53 [ 479 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling env_node ... Pulling remote_proxy_node ... Pulling resolver ... Pulling proxy_list_node ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling env_node ... pulling from altinityinfra/integr... Pulling proxy2 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:40:59 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:46 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:41:46 [ 479 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling env_node ... Pulling remote_proxy_node ... Pulling proxy_list_node ... Pulling resolver ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling env_node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:41:55 [ 479 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling env_node ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling env_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling remote_proxy_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling env_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling env_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling proxy_list_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:42:49 [ 479 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling remote_proxy_node ... Pulling proxy_list_node ... Pulling env_node ... Pulling resolver ... Pulling remote_proxy_node ... pulling from altinityinfra/integr... Pulling env_node ... pulling from altinityinfra/integr... Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... Pulling remote_proxy_node ... status: image is up to date for a... Pulling remote_proxy_node ... done Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... Pulling env_node ... status: image is up to date for a... Pulling env_node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy_list_node ... pulling from altinityinfra/integr... Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... Pulling proxy_list_node ... status: image is up to date for a... Pulling proxy_list_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:42:49 [ 479 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:42:49 [ 479 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:42:49 [ 479 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Docker networks for project roottests3tablefunctionwithhttpsproxy are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:42:49 [ 479 ] DEBUG : Docker containers for project roottests3tablefunctionwithhttpsproxy are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:42:49 [ 479 ] DEBUG : Docker volumes for project roottests3tablefunctionwithhttpsproxy are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:42:49 [ 479 ] DEBUG : Command:docker container list --all --filter name='^/roottests3tablefunctionwithhttpsproxy_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : No running containers for project: roottests3tablefunctionwithhttpsproxy (cluster.py:829, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:42:49 [ 479 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:42:49 [ 479 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Docker networks for project roottests3tablefunctionwithhttpsproxy are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:42:49 [ 479 ] DEBUG : Docker containers for project roottests3tablefunctionwithhttpsproxy are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:42:49 [ 479 ] DEBUG : Docker volumes for project roottests3tablefunctionwithhttpsproxy are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:42:49 [ 479 ] DEBUG : Command:docker container list --all --filter name='^/roottests3tablefunctionwithhttpsproxy_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : No running containers for project: roottests3tablefunctionwithhttpsproxy (cluster.py:829, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:42:49 [ 479 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:42:49 [ 479 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _______________ ERROR at setup of test_s3_with_https_proxy_list ________________ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:48: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling remote_proxy_node ... E Pulling proxy_list_node ... E Pulling env_node ... E Pulling resolver ... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_s3_with_https_remote_proxy _______________ [gw7] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): try: cluster = ClickHouseCluster(__file__) # minio_certs_dir is set only once and used by all instances cluster.add_instance( "remote_proxy_node", main_configs=[ "configs/config.d/proxy_remote.xml", "configs/config.d/ssl.xml", ], with_minio=True, minio_certs_dir="minio_certs", ) cluster.add_instance( "proxy_list_node", main_configs=[ "configs/config.d/proxy_list.xml", "configs/config.d/ssl.xml", ], with_minio=True, ) cluster.add_instance( "env_node", main_configs=[ "configs/config.d/ssl.xml", ], with_minio=True, env_variables={ "https_proxy": "https://proxy1", }, instance_env_variables=True, ) logging.info("Starting cluster...") > cluster.start() test_s3_table_function_with_https_proxy/test.py:48: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/.env', '--project-name', 'roottests3tablefunctionwithhttpsproxy', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/remote_proxy_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/proxy_list_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_s3_table_function_with_https_proxy/_instances_0/env_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling remote_proxy_node ... E Pulling proxy_list_node ... E Pulling env_node ... E Pulling resolver ... E Pulling remote_proxy_node ... pulling from altinityinfra/integr... E Pulling env_node ... pulling from altinityinfra/integr... E Pulling remote_proxy_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling remote_proxy_node ... status: image is up to date for a... E Pulling remote_proxy_node ... done E Pulling env_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling env_node ... status: image is up to date for a... E Pulling env_node ... done E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy_list_node ... pulling from altinityinfra/integr... E Pulling proxy_list_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling proxy_list_node ... status: image is up to date for a... E Pulling proxy_list_node ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_drop_after_fetch ____________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/storage_conf.xml"], with_minio=True, with_zookeeper=True, ) > cluster.start() test_replicated_s3_zero_copy_drop_partition/test.py:25: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... done E Pulling zoo3 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:38:27 [ 486 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:38:27 [ 486 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:38:27 [ 486 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 486 ] DEBUG : Setup Keeper (cluster.py:982, setup_keeper_cmd) 2026-10-26 12:38:27 [ 486 ] DEBUG : Cluster name: project_name:roottestreplicateds3zerocopydroppartition. Added instance name:node1 tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 486 ] INFO : Running tests in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/test.py (cluster.py:2659, start) 2026-10-26 12:38:27 [ 486 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:38:27 [ 486 ] DEBUG : Docker networks for project roottestreplicateds3zerocopydroppartition are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:27 [ 486 ] DEBUG : Docker containers for project roottestreplicateds3zerocopydroppartition are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:27 [ 486 ] DEBUG : Docker volumes for project roottestreplicateds3zerocopydroppartition are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:27 [ 486 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:38:27 [ 486 ] DEBUG : Docker networks for project roottestreplicateds3zerocopydroppartition are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:27 [ 486 ] DEBUG : Docker containers for project roottestreplicateds3zerocopydroppartition are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:27 [ 486 ] DEBUG : Docker volumes for project roottestreplicateds3zerocopydroppartition are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:27 [ 486 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:38:27 [ 486 ] DEBUG : No running containers for project: roottestreplicateds3zerocopydroppartition (cluster.py:829, cleanup) 2026-10-26 12:38:27 [ 486 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:38:27 [ 486 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:38:27 [ 486 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Stderr:Error response from daemon: a prune operation is already running (cluster.py:123, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:38:27 [ 486 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 486 ] DEBUG : Setup directory for instance: node1 (cluster.py:2679, start) 2026-10-26 12:38:27 [ 486 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 486 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 486 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 486 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 486 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 486 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 486 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 486 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 486 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:2993bc2bf171', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:38:27 [ 486 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:27 [ 486 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:27 [ 486 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:27 [ 486 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:27 [ 486 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:38:27 [ 486 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 486 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:39:31 [ 486 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling zoo3 ... Pulling zoo1 ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... done Pulling node1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:39:31 [ 486 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:21 [ 486 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:40:21 [ 486 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy2 ... Pulling zoo2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:40:24 [ 486 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:14 [ 486 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:41:14 [ 486 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo2 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... done Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:41:20 [ 486 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 486 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:42:07 [ 486 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:42:16 [ 486 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:43:00 [ 486 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling proxy2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:43:00 [ 486 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:43:00 [ 486 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:43:00 [ 486 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Docker networks for project roottestreplicateds3zerocopydroppartition are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:43:00 [ 486 ] DEBUG : Docker containers for project roottestreplicateds3zerocopydroppartition are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:43:00 [ 486 ] DEBUG : Docker volumes for project roottestreplicateds3zerocopydroppartition are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:43:00 [ 486 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : No running containers for project: roottestreplicateds3zerocopydroppartition (cluster.py:829, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:43:00 [ 486 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:43:00 [ 486 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Docker networks for project roottestreplicateds3zerocopydroppartition are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:43:00 [ 486 ] DEBUG : Docker containers for project roottestreplicateds3zerocopydroppartition are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:43:00 [ 486 ] DEBUG : Docker volumes for project roottestreplicateds3zerocopydroppartition are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:43:00 [ 486 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicateds3zerocopydroppartition_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : No running containers for project: roottestreplicateds3zerocopydroppartition (cluster.py:829, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:43:00 [ 486 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:43:00 [ 486 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _________________ ERROR at setup of test_drop_complex_columns __________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/storage_conf.xml"], with_minio=True, with_zookeeper=True, ) > cluster.start() test_replicated_s3_zero_copy_drop_partition/test.py:25: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/.env', '--project-name', 'roottestreplicateds3zerocopydroppartition', '--file', '/ClickHouse/tests/integration/test_replicated_s3_zero_copy_drop_partition/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... E Pulling zoo2 ... E Pulling proxy2 ... E Pulling zoo3 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling proxy1 ... done E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling node1 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling node1 ... done E Pulling zoo3 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_delete_after_processing[ordered] ____________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling instance ... Pulling old_instance ... Pulling instance2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling instance ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling old_instance ... pulling from clickhouse/clickhous... Pulling instance ... digest: sha256:8a2c68e2d63d82c826... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling instance2 ... pulling from altinityinfra/integr... Pulling proxy2 ... done Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:38:27 [ 461 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:38:27 [ 461 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:38:27 [ 461 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV HOSTNAME 564b9ab79d02 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV SHLVL 0 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV HOME /root (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV OLDPWD / (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG a2d3dc777d0c (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update 'test_storage_s3_queue/test.py::test_delete_after_processing[ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered]' test_storage_s3_queue/test.py::test_drop_table 'test_storage_s3_queue/test.py::test_failed_retry[ordered]' 'test_storage_s3_queue/test.py::test_failed_retry[unordered]' test_storage_s3_queue/test.py::test_max_set_age test_storage_s3_queue/test.py::test_max_set_size test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered]' 'test_storage_s3_queue/test.py::test_processed_file_setting[1]' 'test_storage_s3_queue/test.py::test_processed_file_setting[5]' 'test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1]' -vvv (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG ce74919e88f5 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV TZ Etc/UTC (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV DOCKER_BASE_TAG 2993bc2bf171 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 74e32b7315b0438db9ac9ea5764b4cde (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV PYTEST_XDIST_WORKER gw1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : ENV PYTEST_CURRENT_TEST test_storage_s3_queue/test.py::test_delete_after_processing[ordered] (setup) (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:696, __init__) 2026-10-26 12:38:27 [ 461 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup Keeper (cluster.py:982, setup_keeper_cmd) 2026-10-26 12:38:27 [ 461 ] DEBUG : Cluster name: project_name:rootteststorages3queue. Added instance name:instance tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 461 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 461 ] DEBUG : Cluster name: project_name:rootteststorages3queue. Added instance name:instance2 tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 461 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 461 ] DEBUG : Cluster name: project_name:rootteststorages3queue. Added instance name:old_instance tag:23.12 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 461 ] INFO : Starting cluster... (test.py:116, started_cluster) 2026-10-26 12:38:27 [ 461 ] INFO : Running tests in /ClickHouse/tests/integration/test_storage_s3_queue/test.py (cluster.py:2659, start) 2026-10-26 12:38:27 [ 461 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:38:27 [ 461 ] DEBUG : Docker networks for project rootteststorages3queue are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:27 [ 461 ] DEBUG : Docker containers for project rootteststorages3queue are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:27 [ 461 ] DEBUG : Docker volumes for project rootteststorages3queue are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:27 [ 461 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:38:27 [ 461 ] DEBUG : Docker networks for project rootteststorages3queue are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:27 [ 461 ] DEBUG : Docker containers for project rootteststorages3queue are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:27 [ 461 ] DEBUG : Docker volumes for project rootteststorages3queue are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:27 [ 461 ] DEBUG : Command:docker container list --all --filter name='^/rootteststorages3queue_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:38:27 [ 461 ] DEBUG : No running containers for project: rootteststorages3queue (cluster.py:829, cleanup) 2026-10-26 12:38:27 [ 461 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:38:27 [ 461 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:38:27 [ 461 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Stderr:Error response from daemon: a prune operation is already running (cluster.py:123, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:38:27 [ 461 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup directory for instance: instance (cluster.py:2679, start) 2026-10-26 12:38:27 [ 461 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_s3_queue/configs/zookeeper.xml', '/ClickHouse/tests/integration/test_storage_s3_queue/configs/s3queue_log.xml'] to /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup directory for instance: instance2 (cluster.py:2679, start) 2026-10-26 12:38:27 [ 461 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_storage_s3_queue/configs/s3queue_log.xml'] to /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup directory for instance: old_instance (cluster.py:2679, start) 2026-10-26 12:38:27 [ 461 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 461 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:2993bc2bf171', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:38:27 [ 461 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:27 [ 461 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:27 [ 461 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:27 [ 461 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:27 [ 461 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:38:27 [ 461 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling fs layer (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... waiting (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (1.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (1.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (0.2%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (15.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (1.6%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (47.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (4.5%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (96.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (9.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (1.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (14.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (21.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (21.6%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (43.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (30.5%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (76.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (39.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (92.2%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (47.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (53.7%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (1.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (58.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (8.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (64.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (59.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (69.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (86.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (76.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (95.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (82.6%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (87.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (92.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... downloading (99.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... verifying checksum (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... download complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (0.2%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (2.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (4.8%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (6.7%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (8.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (9.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (10.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (11.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (13.7%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (14.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (15.8%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (17.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (18.2%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (19.2%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (20.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (21.6%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (23.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (23.8%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (24.8%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (26.2%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (27.5%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (29.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (31.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (33.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (34.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (38.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (41.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (43.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (45.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (46.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (46.8%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (47.2%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (47.5%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (47.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (48.7%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (52.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (54.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (56.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (58.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (60.8%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (62.6%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (65.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (68.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (71.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (73.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (75.3%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (75.9%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (78.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (80.8%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (82.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (83.4%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (85.2%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (87.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (89.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (92.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (94.7%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (97.1%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (99.5%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (3.8%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... extracting (100.0%) (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pull complete (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... status: downloaded newer image fo... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 461 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:39:31 [ 461 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling proxy1 ... Pulling zoo2 ... Pulling old_instance ... Pulling proxy2 ... Pulling minio1 ... Pulling instance ... Pulling instance2 ... Pulling resolver ... Pulling instance ... pulling from altinityinfra/integr... Pulling old_instance ... pulling from clickhouse/clickhous... Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... pulling fs layer Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling old_instance ... waiting Pulling instance ... digest: sha256:8a2c68e2d63d82c826... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling old_instance ... downloading (1.1%) Pulling old_instance ... downloading (100.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (1.1%) Pulling old_instance ... downloading (0.2%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (15.3%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (1.6%) Pulling zoo2 ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling old_instance ... download complete Pulling old_instance ... downloading (100.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (100.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (100.0%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... downloading (47.0%) Pulling old_instance ... downloading (4.5%) Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... done Pulling old_instance ... downloading (96.3%) Pulling old_instance ... downloading (9.3%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling zoo3 ... pulling from altinityinfra/integr... Pulling old_instance ... extracting (1.1%) Pulling old_instance ... downloading (14.0%) Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling old_instance ... extracting (21.4%) Pulling old_instance ... downloading (21.6%) Pulling old_instance ... extracting (43.9%) Pulling old_instance ... downloading (30.5%) Pulling old_instance ... extracting (76.1%) Pulling old_instance ... downloading (39.0%) Pulling old_instance ... extracting (92.2%) Pulling old_instance ... downloading (47.9%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... downloading (53.7%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (1.1%) Pulling old_instance ... downloading (58.4%) Pulling old_instance ... extracting (8.9%) Pulling old_instance ... downloading (64.0%) Pulling old_instance ... extracting (59.3%) Pulling old_instance ... downloading (69.3%) Pulling old_instance ... extracting (86.1%) Pulling old_instance ... downloading (76.1%) Pulling old_instance ... extracting (95.1%) Pulling old_instance ... downloading (82.6%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... downloading (87.4%) Pulling old_instance ... pull complete Pulling old_instance ... downloading (92.9%) Pulling old_instance ... downloading (99.4%) Pulling old_instance ... verifying checksum Pulling old_instance ... download complete Pulling old_instance ... extracting (0.2%) Pulling old_instance ... extracting (2.4%) Pulling old_instance ... extracting (4.8%) Pulling old_instance ... extracting (6.7%) Pulling old_instance ... extracting (8.3%) Pulling old_instance ... extracting (9.1%) Pulling old_instance ... extracting (10.9%) Pulling old_instance ... extracting (11.9%) Pulling old_instance ... extracting (13.7%) Pulling old_instance ... extracting (14.9%) Pulling old_instance ... extracting (15.8%) Pulling old_instance ... extracting (17.0%) Pulling old_instance ... extracting (18.2%) Pulling old_instance ... extracting (19.2%) Pulling old_instance ... extracting (20.4%) Pulling old_instance ... extracting (21.6%) Pulling old_instance ... extracting (23.0%) Pulling old_instance ... extracting (23.8%) Pulling old_instance ... extracting (24.8%) Pulling old_instance ... extracting (26.2%) Pulling old_instance ... extracting (27.5%) Pulling old_instance ... extracting (29.3%) Pulling old_instance ... extracting (31.3%) Pulling old_instance ... extracting (33.1%) Pulling old_instance ... extracting (34.9%) Pulling old_instance ... extracting (38.0%) Pulling old_instance ... extracting (41.0%) Pulling old_instance ... extracting (43.0%) Pulling old_instance ... extracting (45.0%) Pulling old_instance ... extracting (46.4%) Pulling old_instance ... extracting (46.8%) Pulling old_instance ... extracting (47.2%) Pulling old_instance ... extracting (47.5%) Pulling old_instance ... extracting (47.9%) Pulling old_instance ... extracting (48.7%) Pulling old_instance ... extracting (52.3%) Pulling old_instance ... extracting (54.9%) Pulling old_instance ... extracting (56.9%) Pulling old_instance ... extracting (58.4%) Pulling old_instance ... extracting (60.8%) Pulling old_instance ... extracting (62.6%) Pulling old_instance ... extracting (65.0%) Pulling old_instance ... extracting (68.1%) Pulling old_instance ... extracting (71.3%) Pulling old_instance ... extracting (73.3%) Pulling old_instance ... extracting (75.3%) Pulling old_instance ... extracting (75.9%) Pulling old_instance ... extracting (78.1%) Pulling old_instance ... extracting (80.8%) Pulling old_instance ... extracting (82.0%) Pulling old_instance ... extracting (83.4%) Pulling old_instance ... extracting (85.2%) Pulling old_instance ... extracting (87.0%) Pulling old_instance ... extracting (89.1%) Pulling old_instance ... extracting (92.1%) Pulling old_instance ... extracting (94.7%) Pulling old_instance ... extracting (97.1%) Pulling old_instance ... extracting (99.5%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (3.8%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... extracting (100.0%) Pulling old_instance ... extracting (100.0%) Pulling old_instance ... pull complete Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: downloaded newer image fo... Pulling old_instance ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling instance2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... Pulling instance2 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling instance2 ... done Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:39:31 [ 461 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling old_instance ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 461 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:40:32 [ 461 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling proxy2 ... Pulling zoo3 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling instance2 ... Pulling instance ... Pulling old_instance ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... done Pulling zoo3 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling old_instance ... pulling from clickhouse/clickhous... Pulling instance2 ... pulling from altinityinfra/integr... Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling instance ... pulling from altinityinfra/integr... Pulling instance ... digest: sha256:8a2c68e2d63d82c826... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:40:35 [ 461 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling old_instance ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 461 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:41:24 [ 461 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo2 ... Pulling zoo3 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling old_instance ... Pulling instance2 ... Pulling instance ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling old_instance ... pulling from clickhouse/clickhous... Pulling instance2 ... pulling from altinityinfra/integr... Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling instance ... pulling from altinityinfra/integr... Pulling instance ... digest: sha256:8a2c68e2d63d82c826... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:41:30 [ 461 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling old_instance ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:17 [ 461 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:42:17 [ 461 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo3 ... Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling zoo2 ... Pulling old_instance ... Pulling instance ... Pulling instance2 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... done Pulling old_instance ... pulling from clickhouse/clickhous... Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling instance2 ... pulling from altinityinfra/integr... Pulling instance ... pulling from altinityinfra/integr... Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling instance ... digest: sha256:8a2c68e2d63d82c826... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:42:26 [ 461 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling old_instance ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling old_instance ... pulling from clickhouse/clickhous... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling old_instance ... status: image is up to date for c... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling old_instance ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling instance2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:43:21 [ 461 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling instance ... Pulling old_instance ... Pulling instance2 ... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling instance ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling old_instance ... pulling from clickhouse/clickhous... Pulling instance ... digest: sha256:8a2c68e2d63d82c826... Pulling instance ... status: image is up to date for a... Pulling instance ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling instance2 ... pulling from altinityinfra/integr... Pulling proxy2 ... done Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... Pulling old_instance ... status: image is up to date for c... Pulling old_instance ... done Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... Pulling instance2 ... status: image is up to date for a... Pulling instance2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:43:21 [ 461 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:43:21 [ 461 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:43:21 [ 461 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Docker networks for project rootteststorages3queue are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:43:21 [ 461 ] DEBUG : Docker containers for project rootteststorages3queue are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:43:21 [ 461 ] DEBUG : Docker volumes for project rootteststorages3queue are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:43:21 [ 461 ] DEBUG : Command:docker container list --all --filter name='^/rootteststorages3queue_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : No running containers for project: rootteststorages3queue (cluster.py:829, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:43:21 [ 461 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:43:21 [ 461 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Docker networks for project rootteststorages3queue are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:43:21 [ 461 ] DEBUG : Docker containers for project rootteststorages3queue are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:43:21 [ 461 ] DEBUG : Docker volumes for project rootteststorages3queue are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:43:21 [ 461 ] DEBUG : Command:docker container list --all --filter name='^/rootteststorages3queue_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : No running containers for project: rootteststorages3queue (cluster.py:829, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:43:21 [ 461 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:43:21 [ 461 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) __________ ERROR at setup of test_delete_after_processing[unordered] ___________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_direct_select_file[ordered] ______________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_direct_select_file[unordered] _____________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_direct_select_multiple_files[ordered] _________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________ ERROR at setup of test_direct_select_multiple_files[unordered] ________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________________ ERROR at setup of test_drop_table _______________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________________ ERROR at setup of test_failed_retry[ordered] _________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ________________ ERROR at setup of test_failed_retry[unordered] ________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________________ ERROR at setup of test_max_set_age ______________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________________ ERROR at setup of test_max_set_size ______________________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________ ERROR at setup of test_multiple_tables_meta_mismatch _____________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______ ERROR at setup of test_multiple_tables_streaming_sync[unordered] _______ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception __ ERROR at setup of test_multiple_tables_streaming_sync_distributed[ordered] __ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _ ERROR at setup of test_multiple_tables_streaming_sync_distributed[unordered] _ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_processed_file_setting[1] _______________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _______________ ERROR at setup of test_processed_file_setting[5] _______________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _________ ERROR at setup of test_processed_file_setting_distributed[1] _________ [gw1] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster = ClickHouseCluster(__file__) cluster.add_instance( "instance", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/zookeeper.xml", "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "instance2", user_configs=["configs/users.xml"], with_minio=True, with_zookeeper=True, main_configs=[ "configs/s3queue_log.xml", ], stay_alive=True, ) cluster.add_instance( "old_instance", user_configs=["configs/users_old.xml"], with_zookeeper=True, # NOTE (vnemkov) Can't use altinity/clickhouse here since 23.8 doesn't hve S3Queue (and associated settings yet) image="clickhouse/clickhouse-server", tag="23.12", stay_alive=True, with_installed_binary=True, use_old_analyzer=True, ) logging.info("Starting cluster...") > cluster.start() test_storage_s3_queue/test.py:117: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling resolver ... E Pulling minio1 ... E Pulling instance ... E Pulling old_instance ... E Pulling instance2 ... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling resolver ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling zoo2 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling instance ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling old_instance ... pulling from clickhouse/clickhous... E Pulling instance ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance ... status: image is up to date for a... E Pulling instance ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling instance2 ... pulling from altinityinfra/integr... E Pulling proxy2 ... done E Pulling old_instance ... digest: sha256:5d0802b64c09f6d2c6... E Pulling old_instance ... status: image is up to date for c... E Pulling old_instance ... done E Pulling instance2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling instance2 ... status: image is up to date for a... E Pulling instance2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception _____________________ ERROR at setup of test_log_table[s3] _____________________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling switching_node ... Pulling new_node ... Pulling node ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling zoo2 ... done Pulling node ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling new_node ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... Pulling new_node ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling new_node ... done Pulling zoo3 ... done Pulling switching_node ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... Pulling switching_node ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling switching_node ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:38:27 [ 470 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : No running containers (conftest.py:92, cleanup_environment) 2026-10-26 12:38:27 [ 470 ] DEBUG : Pruning Docker networks (conftest.py:94, cleanup_environment) 2026-10-26 12:38:27 [ 470 ] DEBUG : Command:['docker network prune --force'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV HOSTNAME 564b9ab79d02 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV SHLVL 0 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV HOME /root (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV OLDPWD / (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_HELPER_TAG 2cffe1eae894 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG a2d3dc777d0c (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update 'test_storage_s3_queue/test.py::test_delete_after_processing[ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered]' test_storage_s3_queue/test.py::test_drop_table 'test_storage_s3_queue/test.py::test_failed_retry[ordered]' 'test_storage_s3_queue/test.py::test_failed_retry[unordered]' test_storage_s3_queue/test.py::test_max_set_age test_storage_s3_queue/test.py::test_max_set_size test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered]' 'test_storage_s3_queue/test.py::test_processed_file_setting[1]' 'test_storage_s3_queue/test.py::test_processed_file_setting[5]' 'test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1]' -vvv (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG ce74919e88f5 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV TZ Etc/UTC (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV DOCKER_BASE_TAG 2993bc2bf171 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID 74e32b7315b0438db9ac9ea5764b4cde (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV PYTEST_XDIST_WORKER gw4 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : ENV PYTEST_CURRENT_TEST test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] (setup) (cluster.py:400, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:696, __init__) 2026-10-26 12:38:27 [ 470 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup Keeper (cluster.py:982, setup_keeper_cmd) 2026-10-26 12:38:27 [ 470 ] DEBUG : Cluster name:backward_compatibility project_name:roottestremoteblobsnamingbackwardcompatibility. Added instance name:node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 470 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 470 ] DEBUG : Cluster name:backward_compatibility project_name:roottestremoteblobsnamingbackwardcompatibility. Added instance name:new_node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 470 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:38:27 [ 470 ] DEBUG : Cluster name:backward_compatibility project_name:roottestremoteblobsnamingbackwardcompatibility. Added instance name:switching_node tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:38:27 [ 470 ] INFO : Starting cluster... (test_backward_compatibility.py:55, cluster) 2026-10-26 12:38:27 [ 470 ] INFO : Running tests in /ClickHouse/tests/integration/test_remote_blobs_naming/test_backward_compatibility.py (cluster.py:2659, start) 2026-10-26 12:38:27 [ 470 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:38:27 [ 470 ] DEBUG : Docker networks for project roottestremoteblobsnamingbackwardcompatibility are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:27 [ 470 ] DEBUG : Docker containers for project roottestremoteblobsnamingbackwardcompatibility are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:27 [ 470 ] DEBUG : Docker volumes for project roottestremoteblobsnamingbackwardcompatibility are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:27 [ 470 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:38:27 [ 470 ] DEBUG : Docker networks for project roottestremoteblobsnamingbackwardcompatibility are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:38:27 [ 470 ] DEBUG : Docker containers for project roottestremoteblobsnamingbackwardcompatibility are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:38:27 [ 470 ] DEBUG : Docker volumes for project roottestremoteblobsnamingbackwardcompatibility are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:38:27 [ 470 ] DEBUG : Command:docker container list --all --filter name='^/roottestremoteblobsnamingbackwardcompatibility_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:38:27 [ 470 ] DEBUG : No running containers for project: roottestremoteblobsnamingbackwardcompatibility (cluster.py:829, cleanup) 2026-10-26 12:38:27 [ 470 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:38:27 [ 470 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:38:27 [ 470 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:38:27 [ 470 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:38:27 [ 470 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup directory for instance: node (cluster.py:2679, start) 2026-10-26 12:38:27 [ 470 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_remote_blobs_naming/configs/old_node.xml', '/ClickHouse/tests/integration/test_remote_blobs_naming/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup directory for instance: new_node (cluster.py:2679, start) 2026-10-26 12:38:27 [ 470 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_remote_blobs_naming/configs/new_node.xml', '/ClickHouse/tests/integration/test_remote_blobs_naming/configs/storage_conf_new.xml'] to /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup directory for instance: switching_node (cluster.py:2679, start) 2026-10-26 12:38:27 [ 470 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_remote_blobs_naming/configs/switching_node.xml', '/ClickHouse/tests/integration/test_remote_blobs_naming/configs/storage_conf.xml'] to /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/database (cluster.py:4488, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/logs (cluster.py:4499, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Entrypoint cmd: bash -c "trap 'pkill tail' INT TERM; clickhouse server --config-file=/etc/clickhouse-server/config.xml --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log --daemon; coproc tail -f /dev/null; wait $$!" (cluster.py:4582, create_dir) 2026-10-26 12:38:27 [ 470 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:2993bc2bf171', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:38:27 [ 470 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:27 [ 470 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:27 [ 470 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:38:27 [ 470 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:38:27 [ 470 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:38:27 [ 470 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:39:31 [ 470 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:39:31 [ 470 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo2 ... Pulling zoo1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling switching_node ... Pulling new_node ... Pulling node ... Pulling new_node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... Pulling new_node ... status: image is up to date for a... Pulling new_node ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling switching_node ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:39:31 [ 470 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:32 [ 470 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:40:32 [ 470 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo1 ... Pulling switching_node ... Pulling new_node ... Pulling node ... Pulling node ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling new_node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... Pulling new_node ... status: image is up to date for a... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling new_node ... done Pulling resolver ... done Pulling zoo3 ... done Pulling switching_node ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:40:35 [ 470 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:35 [ 470 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:41:35 [ 470 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling zoo1 ... Pulling proxy2 ... Pulling resolver ... Pulling zoo3 ... Pulling zoo2 ... Pulling minio1 ... Pulling node ... Pulling new_node ... Pulling switching_node ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling new_node ... pulling from altinityinfra/integr... Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... Pulling new_node ... status: image is up to date for a... Pulling new_node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling node ... pulling from altinityinfra/integr... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling node ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling switching_node ... pulling from altinityinfra/integr... Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:41:41 [ 470 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:38 [ 470 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:42:38 [ 470 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling zoo2 ... Pulling new_node ... Pulling node ... Pulling switching_node ... Pulling new_node ... pulling from altinityinfra/integr... Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... Pulling new_node ... status: image is up to date for a... Pulling new_node ... done Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling switching_node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling resolver ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling node ... done Pulling proxy2 ... done Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... Pulling switching_node ... status: image is up to date for a... Pulling switching_node ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:42:47 [ 470 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling switching_node ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling new_node ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling node ... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling node ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling new_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling new_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling new_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling switching_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling switching_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling switching_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:43:42 [ 470 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling switching_node ... Pulling new_node ... Pulling node ... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling node ... digest: sha256:8a2c68e2d63d82c826... Pulling node ... status: image is up to date for a... Pulling zoo2 ... done Pulling node ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling new_node ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... Pulling new_node ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling new_node ... done Pulling zoo3 ... done Pulling switching_node ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... Pulling switching_node ... status: image is up to date for a... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling switching_node ... done Pulling zoo1 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:43:42 [ 470 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:43:42 [ 470 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:43:42 [ 470 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:43:42 [ 470 ] DEBUG : Docker networks for project roottestremoteblobsnamingbackwardcompatibility are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:43:42 [ 470 ] DEBUG : Docker containers for project roottestremoteblobsnamingbackwardcompatibility are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:43:42 [ 470 ] DEBUG : Docker volumes for project roottestremoteblobsnamingbackwardcompatibility are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:43:42 [ 470 ] DEBUG : Command:docker container list --all --filter name='^/roottestremoteblobsnamingbackwardcompatibility_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:43:42 [ 470 ] DEBUG : No running containers for project: roottestremoteblobsnamingbackwardcompatibility (cluster.py:829, cleanup) 2026-10-26 12:43:42 [ 470 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:43:42 [ 470 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:43:42 [ 470 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:43:42 [ 470 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:43:42 [ 470 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:43:42 [ 470 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) __________________ ERROR at setup of test_log_table[s3_plain] __________________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ____________________ ERROR at setup of test_read_new_format ____________________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case0] ___________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case1] ___________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case2] ___________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case3] ___________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________ ERROR at setup of test_replicated_merge_tree[test_case4] ___________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ___________________ ERROR at setup of test_write_new_format ____________________ [gw4] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def cluster(): cluster = ClickHouseCluster(__file__) cluster.add_instance( "node", main_configs=[ "configs/old_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "1"}, with_zookeeper=True, ) cluster.add_instance( "new_node", main_configs=[ "configs/new_node.xml", "configs/storage_conf_new.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, macros={"replica": "2"}, with_zookeeper=True, ) cluster.add_instance( "switching_node", main_configs=[ "configs/switching_node.xml", "configs/storage_conf.xml", ], user_configs=[ "configs/settings.xml", ], with_minio=True, with_zookeeper=True, stay_alive=True, ) logging.info("Starting cluster...") > cluster.start() test_remote_blobs_naming/test_backward_compatibility.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/.env', '--project-name', 'roottestremoteblobsnamingbackwardcompatibility', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/new_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_remote_blobs_naming/_instances_backward_compatibility_0/switching_node/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling zoo3 ... E Pulling zoo1 ... E Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling resolver ... E Pulling switching_node ... E Pulling new_node ... E Pulling node ... E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling node ... pulling from altinityinfra/integr... E Pulling resolver ... pulling from altinityinfra/python... E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling node ... digest: sha256:8a2c68e2d63d82c826... E Pulling node ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling node ... done E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling new_node ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling new_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling new_node ... status: image is up to date for a... E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling new_node ... done E Pulling zoo3 ... done E Pulling switching_node ... pulling from altinityinfra/integr... E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling switching_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling switching_node ... status: image is up to date for a... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling switching_node ... done E Pulling zoo1 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ______________ ERROR at setup of test_vertical_merge_memory_usage ______________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_single_node_cluster(): try: > single_node_cluster.start() test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py:20: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... E Pulling proxy1 ... E Pulling minio1 ... E Pulling small_node ... E Pulling resolver ... E Pulling small_node ... pulling from altinityinfra/integr... E Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... E Pulling small_node ... status: image is up to date for a... E Pulling small_node ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling resolver ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling proxy1 ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... Pulling small_node ... pulling from altinityinfra/integr... Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:39:58 [ 467 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py (cluster.py:2659, start) 2026-10-26 12:39:58 [ 467 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:39:58 [ 467 ] DEBUG : Docker networks for project roottests3zerocopyttlverticalmergememoryusage are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:39:59 [ 467 ] DEBUG : Docker containers for project roottests3zerocopyttlverticalmergememoryusage are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:39:59 [ 467 ] DEBUG : Docker volumes for project roottests3zerocopyttlverticalmergememoryusage are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:39:59 [ 467 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:39:59 [ 467 ] DEBUG : Docker networks for project roottests3zerocopyttlverticalmergememoryusage are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:39:59 [ 467 ] DEBUG : Docker containers for project roottests3zerocopyttlverticalmergememoryusage are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:39:59 [ 467 ] DEBUG : Docker volumes for project roottests3zerocopyttlverticalmergememoryusage are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:39:59 [ 467 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyttlverticalmergememoryusage_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:39:59 [ 467 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:39:59 [ 467 ] DEBUG : No running containers for project: roottests3zerocopyttlverticalmergememoryusage (cluster.py:829, cleanup) 2026-10-26 12:39:59 [ 467 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:39:59 [ 467 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:39:59 [ 467 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:39:59 [ 467 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:39:59 [ 467 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:39:59 [ 467 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:39:59 [ 467 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:39:59 [ 467 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:39:59 [ 467 ] DEBUG : Setup directory for instance: small_node (cluster.py:2679, start) 2026-10-26 12:39:59 [ 467 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:39:59 [ 467 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:39:59 [ 467 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:39:59 [ 467 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:39:59 [ 467 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_s3_zero_copy_ttl/configs/s3.xml'] to /ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:39:59 [ 467 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/database (cluster.py:4488, create_dir) 2026-10-26 12:39:59 [ 467 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/logs (cluster.py:4499, create_dir) 2026-10-26 12:39:59 [ 467 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:39:59 [ 467 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:39:59 [ 467 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:39:59 [ 467 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:39:59 [ 467 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:39:59 [ 467 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:39:59 [ 467 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:39:59 [ 467 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:40:42 [ 467 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:40:42 [ 467 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling small_node ... pulling from altinityinfra/integr... Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:40:42 [ 467 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 467 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:41:24 [ 467 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling resolver ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling small_node ... pulling from altinityinfra/integr... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:41:27 [ 467 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 467 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:42:07 [ 467 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling small_node ... pulling from altinityinfra/integr... Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:42:13 [ 467 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:00 [ 467 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:43:00 [ 467 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... Pulling small_node ... pulling from altinityinfra/integr... Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:43:09 [ 467 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling small_node ... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling small_node ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling small_node ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling small_node ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:43:52 [ 467 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/.env', '--project-name', 'roottests3zerocopyttlverticalmergememoryusage', '--file', '/ClickHouse/tests/integration/test_s3_zero_copy_ttl/_instances_vertical_merge_memory_usage_0/small_node/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling minio1 ... Pulling small_node ... Pulling resolver ... Pulling small_node ... pulling from altinityinfra/integr... Pulling small_node ... digest: sha256:8a2c68e2d63d82c826... Pulling small_node ... status: image is up to date for a... Pulling small_node ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:43:52 [ 467 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:43:52 [ 467 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:43:52 [ 467 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:43:52 [ 467 ] DEBUG : Docker networks for project roottests3zerocopyttlverticalmergememoryusage are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:43:52 [ 467 ] DEBUG : Docker containers for project roottests3zerocopyttlverticalmergememoryusage are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:43:52 [ 467 ] DEBUG : Docker volumes for project roottests3zerocopyttlverticalmergememoryusage are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:43:52 [ 467 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyttlverticalmergememoryusage_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:43:52 [ 467 ] DEBUG : No running containers for project: roottests3zerocopyttlverticalmergememoryusage (cluster.py:829, cleanup) 2026-10-26 12:43:52 [ 467 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:43:52 [ 467 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:43:52 [ 467 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:43:52 [ 467 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:43:52 [ 467 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:43:52 [ 467 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:43:53 [ 467 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:43:53 [ 467 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:43:53 [ 467 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:43:53 [ 467 ] DEBUG : Docker networks for project roottests3zerocopyttlverticalmergememoryusage are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:43:53 [ 467 ] DEBUG : Docker containers for project roottests3zerocopyttlverticalmergememoryusage are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:43:53 [ 467 ] DEBUG : Docker volumes for project roottests3zerocopyttlverticalmergememoryusage are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:43:53 [ 467 ] DEBUG : Command:docker container list --all --filter name='^/roottests3zerocopyttlverticalmergememoryusage_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:43:53 [ 467 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:43:53 [ 467 ] DEBUG : No running containers for project: roottests3zerocopyttlverticalmergememoryusage (cluster.py:829, cleanup) 2026-10-26 12:43:53 [ 467 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:43:53 [ 467 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:43:53 [ 467 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:43:53 [ 467 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:43:53 [ 467 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:43:53 [ 467 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:43:53 [ 467 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:43:53 [ 467 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) _________________ ERROR at setup of test_replicated_db_and_ttl _________________ [gw5] linux -- Python 3.10.12 /usr/bin/python3 @pytest.fixture(scope="module") def started_cluster(): try: cluster.add_instance( "node1", main_configs=["configs/node1_macro.xml"], user_configs=[ "configs/enable_parallel_replicas.xml", ], with_minio=True, with_zookeeper=True, ) > cluster.start() test_replicated_merge_tree_replicated_db_ttl/test.py:29: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:2699: in start raise ex helpers/cluster.py:2695: in start run_and_check(images_pull_cmd) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', ...] env = None, shell = False, stdout = -1, stderr = -1, timeout = 300 nothrow = False, detach = False def run_and_check( args, env=None, shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE, timeout=300, nothrow=False, detach=False, ): if detach: subprocess.Popen( args, stdout=subprocess.DEVNULL, stderr=subprocess.DEVNULL, env=env, shell=shell, ) return logging.debug(f"Command:{args}") res = subprocess.run( args, stdout=stdout, stderr=stderr, env=env, shell=shell, timeout=timeout ) out = res.stdout.decode("utf-8", "ignore") err = res.stderr.decode("utf-8", "ignore") # check_call(...) from subprocess does not print stderr, so we do it manually for outline in out.splitlines(): logging.debug(f"Stdout:{outline}") for errline in err.splitlines(): logging.debug(f"Stderr:{errline}") if res.returncode != 0: logging.debug(f"Exitcode:{res.returncode}") if env: logging.debug(f"Env:{env}") if not nothrow: > raise Exception( f"Command {args} return non-zero code {res.returncode}: {res.stderr.decode('utf-8')}" ) E Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... E Pulling proxy1 ... E Pulling zoo1 ... E Pulling zoo3 ... E Pulling proxy2 ... E Pulling minio1 ... E Pulling node1 ... E Pulling resolver ... E Pulling node1 ... pulling from altinityinfra/integr... E Pulling proxy2 ... pulling from altinityinfra/s3-proxy E Pulling zoo2 ... pulling from altinityinfra/integr... E Pulling proxy1 ... pulling from altinityinfra/s3-proxy E Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling node1 ... status: image is up to date for a... E Pulling node1 ... done E Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy2 ... status: image is up to date for a... E Pulling proxy2 ... done E Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo2 ... status: image is up to date for a... E Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... E Pulling proxy1 ... status: image is up to date for a... E Pulling zoo2 ... done E Pulling proxy1 ... done E Pulling zoo1 ... pulling from altinityinfra/integr... E Pulling zoo3 ... pulling from altinityinfra/integr... E Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo1 ... status: image is up to date for a... E Pulling zoo1 ... done E Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... E Pulling zoo3 ... status: image is up to date for a... E Pulling zoo3 ... done E Pulling resolver ... pulling from altinityinfra/python... E Pulling resolver ... digest: sha256:6004f5bd254dd16f55... E Pulling resolver ... status: image is up to date for a... E Pulling resolver ... done E Pulling minio1 ... error E E ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied E pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied helpers/cluster.py:129: Exception ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- Traceback (most recent call last): File "/ClickHouse/tests/integration/helpers/cluster.py", line 2699, in start raise ex File "/ClickHouse/tests/integration/helpers/cluster.py", line 2695, in start run_and_check(images_pull_cmd) File "/ClickHouse/tests/integration/helpers/cluster.py", line 129, in run_and_check raise Exception( Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied ------------------------------ Captured log setup ------------------------------ 2026-10-26 12:40:39 [ 473 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1670, add_instance) 2026-10-26 12:40:39 [ 473 ] DEBUG : Setup Keeper (cluster.py:982, setup_keeper_cmd) 2026-10-26 12:40:39 [ 473 ] DEBUG : Cluster name: project_name:roottestreplicatedmergetreereplicateddbttl. Added instance name:node1 tag:2993bc2bf171 base_cmd:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:1952, add_instance) 2026-10-26 12:40:39 [ 473 ] INFO : Running tests in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/test.py (cluster.py:2659, start) 2026-10-26 12:40:39 [ 473 ] DEBUG : Cluster start called. is_up=False (cluster.py:2666, start) 2026-10-26 12:40:39 [ 473 ] DEBUG : Docker networks for project roottestreplicatedmergetreereplicateddbttl are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:40:39 [ 473 ] DEBUG : Docker containers for project roottestreplicatedmergetreereplicateddbttl are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:40:39 [ 473 ] DEBUG : Docker volumes for project roottestreplicatedmergetreereplicateddbttl are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:40:39 [ 473 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:40:39 [ 473 ] DEBUG : Docker networks for project roottestreplicatedmergetreereplicateddbttl are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:40:39 [ 473 ] DEBUG : Docker containers for project roottestreplicatedmergetreereplicateddbttl are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:40:39 [ 473 ] DEBUG : Docker volumes for project roottestreplicatedmergetreereplicateddbttl are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:40:39 [ 473 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:40:39 [ 473 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:40:39 [ 473 ] DEBUG : No running containers for project: roottestreplicatedmergetreereplicateddbttl (cluster.py:829, cleanup) 2026-10-26 12:40:39 [ 473 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:40:39 [ 473 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:40:39 [ 473 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:40:39 [ 473 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:40:39 [ 473 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:40:39 [ 473 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:40:39 [ 473 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:40:39 [ 473 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:40:39 [ 473 ] DEBUG : Setup directory for instance: node1 (cluster.py:2679, start) 2026-10-26 12:40:39 [ 473 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4383, create_dir) 2026-10-26 12:40:39 [ 473 ] DEBUG : Create directory for common tests configuration (cluster.py:4388, create_dir) 2026-10-26 12:40:39 [ 473 ] DEBUG : Copy common configuration from helpers (cluster.py:4408, create_dir) 2026-10-26 12:40:39 [ 473 ] DEBUG : Generate and write macros file (cluster.py:4441, create_dir) 2026-10-26 12:40:39 [ 473 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/configs/node1_macro.xml'] to /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/configs/config.d (cluster.py:4471, create_dir) 2026-10-26 12:40:39 [ 473 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/database (cluster.py:4488, create_dir) 2026-10-26 12:40:39 [ 473 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/logs (cluster.py:4499, create_dir) 2026-10-26 12:40:39 [ 473 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4582, create_dir) 2026-10-26 12:40:39 [ 473 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:2993bc2bf171', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/keeper3/coordination', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/minio/certs/public.crt'} stored in /ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env (cluster.py:86, _create_env_file) 2026-10-26 12:40:39 [ 473 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:40:39 [ 473 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:40:39 [ 473 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2026-10-26 12:40:39 [ 473 ] DEBUG : No config file found (config.py:28, find_config_file) 2026-10-26 12:40:39 [ 473 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2026-10-26 12:40:39 [ 473 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:40:44 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:40:47 [ 473 ] INFO : Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:40:47 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:40:51 [ 473 ] INFO : Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:40:57 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:41:01 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:41:03 [ 473 ] INFO : Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:41:06 [ 473 ] INFO : Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:41:14 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:41:16 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:41:23 [ 473 ] INFO : Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:41:24 [ 473 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:41:24 [ 473 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling resolver ... Pulling minio1 ... Pulling zoo1 ... Pulling zoo3 ... Pulling node1 ... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:41:24 [ 473 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:41:28 [ 473 ] INFO : Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:41:33 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:41:38 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:41:48 [ 473 ] INFO : Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:41:58 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:07 [ 473 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:42:07 [ 473 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy2 ... Pulling proxy1 ... Pulling resolver ... Pulling zoo3 ... Pulling zoo1 ... Pulling minio1 ... Pulling zoo2 ... Pulling node1 ... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo3 ... done Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:42:08 [ 473 ] INFO : Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:42:10 [ 473 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:42:18 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:42:29 [ 473 ] INFO : Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:42:39 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:42:49 [ 473 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:42:49 [ 473 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo3 ... Pulling zoo1 ... Pulling proxy2 ... Pulling zoo2 ... Pulling proxy1 ... Pulling minio1 ... Pulling resolver ... Pulling node1 ... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling node1 ... done Pulling zoo3 ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling zoo2 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:42:55 [ 473 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:43:10 [ 473 ] INFO : Connecting to 172.16.7.2(172.16.7.2):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:43:20 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:43:31 [ 473 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:43:31 [ 473 ] INFO : Got exception pulling images: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo1 ... Pulling zoo2 ... Pulling proxy1 ... Pulling proxy2 ... Pulling minio1 ... Pulling zoo3 ... Pulling node1 ... Pulling resolver ... Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling zoo2 ... pulling from altinityinfra/integr... Pulling node1 ... pulling from altinityinfra/integr... Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling node1 ... done Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling proxy2 ... done Pulling proxy1 ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:2700, start) 2026-10-26 12:43:31 [ 473 ] INFO : Connecting to 172.16.7.3(172.16.7.3):2181, use_ssl: False (connection.py:650, _connect) 2026-10-26 12:43:40 [ 473 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] (cluster.py:113, run_and_check) 2026-10-26 12:43:41 [ 473 ] WARNING : Connection dropped: socket connection error: None (connection.py:622, _connect_attempt) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling minio1 ... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... pulling from altinityinfra/s3-proxy (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling node1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling proxy1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... pulling from altinityinfra/python... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... digest: sha256:6004f5bd254dd16f55... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... status: image is up to date for a... (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling resolver ... done (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:Pulling minio1 ... error (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr: (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stderr:pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:123, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Exitcode:1 (cluster.py:125, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Failed to start cluster: (cluster.py:3030, start) 2026-10-26 12:44:24 [ 473 ] DEBUG : Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/.env', '--project-name', 'roottestreplicatedmergetreereplicateddbttl', '--file', '/ClickHouse/tests/integration/test_replicated_merge_tree_replicated_db_ttl/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... Pulling proxy1 ... Pulling zoo1 ... Pulling zoo3 ... Pulling proxy2 ... Pulling minio1 ... Pulling node1 ... Pulling resolver ... Pulling node1 ... pulling from altinityinfra/integr... Pulling proxy2 ... pulling from altinityinfra/s3-proxy Pulling zoo2 ... pulling from altinityinfra/integr... Pulling proxy1 ... pulling from altinityinfra/s3-proxy Pulling node1 ... digest: sha256:8a2c68e2d63d82c826... Pulling node1 ... status: image is up to date for a... Pulling node1 ... done Pulling proxy2 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy2 ... status: image is up to date for a... Pulling proxy2 ... done Pulling zoo2 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo2 ... status: image is up to date for a... Pulling proxy1 ... digest: sha256:92e86c3de6b8ff00d8... Pulling proxy1 ... status: image is up to date for a... Pulling zoo2 ... done Pulling proxy1 ... done Pulling zoo1 ... pulling from altinityinfra/integr... Pulling zoo3 ... pulling from altinityinfra/integr... Pulling zoo1 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo1 ... status: image is up to date for a... Pulling zoo1 ... done Pulling zoo3 ... digest: sha256:8a2c68e2d63d82c826... Pulling zoo3 ... status: image is up to date for a... Pulling zoo3 ... done Pulling resolver ... pulling from altinityinfra/python... Pulling resolver ... digest: sha256:6004f5bd254dd16f55... Pulling resolver ... status: image is up to date for a... Pulling resolver ... done Pulling minio1 ... error ERROR: for minio1 pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied pull access denied for minio/minio, repository does not exist or may require 'docker login': denied: requested access to the resource is denied (cluster.py:3031, start) 2026-10-26 12:44:24 [ 473 ] DEBUG : None (cluster.py:3032, start) 2026-10-26 12:44:24 [ 473 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:44:24 [ 473 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Docker networks for project roottestreplicatedmergetreereplicateddbttl are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:44:24 [ 473 ] DEBUG : Docker containers for project roottestreplicatedmergetreereplicateddbttl are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:44:24 [ 473 ] DEBUG : Docker volumes for project roottestreplicatedmergetreereplicateddbttl are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:44:24 [ 473 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : No running containers for project: roottestreplicatedmergetreereplicateddbttl (cluster.py:829, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) 2026-10-26 12:44:24 [ 473 ] WARNING : docker-compose up was not called. Trying to export docker.log for running containers (cluster.py:3098, shutdown) 2026-10-26 12:44:24 [ 473 ] DEBUG : Cleanup called (cluster.py:801, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Docker networks for project roottestreplicatedmergetreereplicateddbttl are NETWORK ID NAME DRIVER SCOPE (cluster.py:780, print_all_docker_pieces) 2026-10-26 12:44:24 [ 473 ] DEBUG : Docker containers for project roottestreplicatedmergetreereplicateddbttl are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:788, print_all_docker_pieces) 2026-10-26 12:44:24 [ 473 ] DEBUG : Docker volumes for project roottestreplicatedmergetreereplicateddbttl are DRIVER VOLUME NAME (cluster.py:796, print_all_docker_pieces) 2026-10-26 12:44:24 [ 473 ] DEBUG : Command:docker container list --all --filter name='^/roottestreplicatedmergetreereplicateddbttl_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:113, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Unstopped containers: {} (cluster.py:815, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : No running containers for project: roottestreplicatedmergetreereplicateddbttl (cluster.py:829, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Trying to prune unused networks... (cluster.py:835, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Trying to prune unused images... (cluster.py:851, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:113, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:121, run_and_check) 2026-10-26 12:44:24 [ 473 ] DEBUG : Images pruned (cluster.py:854, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Trying to prune unused volumes... (cluster.py:860, cleanup) 2026-10-26 12:44:24 [ 473 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:113, run_and_check) 2026-10-26 12:44:25 [ 473 ] DEBUG : Stdout:1 (cluster.py:121, run_and_check) ============================== slowest durations =============================== 314.85s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 294.10s setup test_storage_s3_queue/test.py::test_delete_after_processing[ordered] 272.96s setup test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 262.32s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy 241.30s setup test_storage_hudi/test.py::test_multiple_hudi_files 234.28s setup test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage 225.46s setup test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 30.79s setup test_recovery_replica/test.py::test_update_metadata 25.34s setup test_replace_partition/test.py::test_normal_work 25.26s setup test_storage_redis/test.py::test_create_table 22.26s teardown test_session_log/test.py::test_postgres_session 22.13s setup test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with 20.52s setup test_reloading_storage_configuration/test.py::test_add_disk 20.16s call test_recovery_replica/test.py::test_update_metadata 18.81s setup test_settings_constraints_distributed/test.py::test_insert_clamps_settings 18.45s setup test_session_log/test.py::test_grpc_session 17.11s call test_reload_zookeeper/test.py::test_reload_zookeeper 15.52s setup test_rocksdb_options/test.py::test_invalid_block_based_table_options 14.65s setup test_reload_query_masking_rules/test.py::test_reload_query_masking_rules 13.69s call test_rocksdb_options/test.py::test_table_invalid_options 12.69s call test_rocksdb_options/test.py::test_table_invalid_column_family_options 12.32s teardown test_row_policy/test.py::test_with_prewhere 12.22s teardown test_reload_zookeeper/test.py::test_reload_zookeeper 11.95s setup test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 11.71s call test_rocksdb_options/test.py::test_invalid_options 11.62s call test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 11.60s call test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 11.54s call test_rocksdb_options/test.py::test_invalid_column_family_options 11.25s setup test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings 11.13s call test_rocksdb_options/test.py::test_invalid_block_based_table_options 10.11s setup test_reload_zookeeper/test.py::test_reload_zookeeper 9.46s call test_row_policy/test.py::test_change_of_users_xml_changes_row_policies 9.11s teardown test_recovery_replica/test.py::test_update_metadata 8.07s call test_reloading_storage_configuration/test.py::test_add_policy 8.03s call test_reloading_storage_configuration/test.py::test_remove_disk_from_policy 7.59s call test_reloading_storage_configuration/test.py::test_remove_disk 7.31s call test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 7.17s call test_row_policy/test.py::test_dcl_introspection 7.01s call test_reloading_storage_configuration/test.py::test_update_disk 6.76s setup test_settings_constraints_distributed/test.py::test_select_clamps_settings 6.47s call test_reloading_storage_configuration/test.py::test_new_policy_works 6.46s setup test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 6.45s call test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config 6.43s call test_settings_constraints_distributed/test.py::test_select_clamps_settings 6.38s call test_reloading_storage_configuration/test.py::test_remove_policy 6.37s call test_reloading_storage_configuration/test.py::test_add_disk_to_policy 6.01s teardown test_replace_partition/test.py::test_normal_work 5.87s call test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 5.78s call test_reloading_storage_configuration/test.py::test_add_volume_to_policy 5.77s call test_reloading_storage_configuration/test.py::test_add_disk 5.71s call test_row_policy/test.py::test_reload_users_xml_by_timer 5.71s call test_row_policy/test.py::test_grant_create_row_policy 5.10s teardown test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings 4.90s call test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with 4.89s call test_row_policy/test.py::test_some_users_without_policies 4.59s call test_row_policy/test.py::test_with_prewhere 4.42s teardown test_reload_query_masking_rules/test.py::test_reload_query_masking_rules 4.13s call test_session_log/test.py::test_parallel_sessions 4.05s call test_row_policy/test.py::test_dcl_management 4.04s teardown test_storage_redis/test.py::test_update 4.03s teardown test_settings_constraints_distributed/test.py::test_select_clamps_settings 4.00s call test_row_policy/test.py::test_miscellaneous_engines 3.85s teardown test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 3.53s teardown test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data 3.32s teardown test_reloading_storage_configuration/test.py::test_update_disk 3.16s teardown test_replication_without_zookeeper/test.py::test_startup_without_zookeeper 2.90s call test_row_policy/test.py::test_smoke 2.71s call test_row_policy/test.py::test_row_policy_filter_with_subquery 2.60s teardown test_row_policy/test.py::test_row_policy_filter_with_subquery 2.58s call test_settings_constraints_distributed/test.py::test_insert_clamps_settings 2.50s teardown test_row_policy/test.py::test_tags_with_db_and_table_names 2.45s teardown test_row_policy/test.py::test_some_users_without_policies 2.44s teardown test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter 2.43s call test_replace_partition/test.py::test_normal_work 2.43s teardown test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data 2.39s teardown test_row_policy/test.py::test_users_xml_is_readonly 2.37s teardown test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml 2.33s teardown test_row_policy/test.py::test_change_of_users_xml_changes_row_policies 2.29s teardown test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with 2.27s teardown test_row_policy/test.py::test_join 2.26s teardown test_row_policy/test.py::test_grant_create_row_policy 2.23s teardown test_row_policy/test.py::test_dcl_introspection 2.20s teardown test_row_policy/test.py::test_introspection 2.19s teardown test_row_policy/test.py::test_dcl_management 2.11s teardown test_row_policy/test.py::test_miscellaneous_engines 2.09s teardown test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter 2.03s call test_row_policy/test.py::test_policy_on_distributed_table_via_role 2.01s call test_storage_redis/test.py::test_create_table 1.98s teardown test_row_policy/test.py::test_smoke 1.95s call test_session_log/test.py::test_grpc_session 1.93s teardown test_rocksdb_options/test.py::test_valid_options 1.88s teardown test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned 1.87s teardown test_row_policy/test.py::test_reload_users_xml_by_timer 1.87s teardown test_row_policy/test.py::test_policy_on_distributed_table_via_role 1.85s call test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data 1.84s call test_row_policy/test.py::test_tags_with_db_and_table_names 1.81s call test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data 1.76s call test_session_log/test.py::test_postgres_session 1.57s call test_storage_redis/test.py::test_delete 1.57s call test_storage_redis/test.py::test_simple_insert 1.55s call test_session_log/test.py::test_mysql_session 1.49s call test_reload_query_masking_rules/test.py::test_reload_query_masking_rules 1.15s call test_storage_redis/test.py::test_update 1.09s call test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned 1.03s call test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml 1.02s call test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter 0.98s call test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter 0.94s call test_storage_redis/test.py::test_truncate 0.88s call test_rocksdb_options/test.py::test_valid_options 0.87s call test_storage_redis/test.py::test_simple_select 0.87s call test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings 0.82s call test_storage_redis/test.py::test_select_int 0.43s call test_row_policy/test.py::test_join 0.27s call test_row_policy/test.py::test_users_xml_is_readonly 0.27s call test_rocksdb_options/test.py::test_valid_column_family_options 0.22s call test_rocksdb_options/test.py::test_table_valid_column_family_options 0.22s call test_row_policy/test.py::test_introspection 0.22s call test_rocksdb_options/test.py::test_table_valid_options 0.00s setup test_storage_redis/test.py::test_update 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_disk_from_policy 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_disk 0.00s setup test_row_policy/test.py::test_grant_create_row_policy 0.00s setup test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter 0.00s setup test_row_policy/test.py::test_some_users_without_policies 0.00s teardown test_storage_redis/test.py::test_create_table 0.00s setup test_storage_redis/test.py::test_delete 0.00s setup test_row_policy/test.py::test_change_of_users_xml_changes_row_policies 0.00s teardown test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl 0.00s setup test_row_policy/test.py::test_join 0.00s setup test_storage_redis/test.py::test_select_int 0.00s setup test_row_policy/test.py::test_with_prewhere 0.00s setup test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned 0.00s setup test_storage_redis/test.py::test_truncate 0.00s setup test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data 0.00s setup test_session_log/test.py::test_mysql_session 0.00s setup test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter 0.00s setup test_session_log/test.py::test_postgres_session 0.00s setup test_row_policy/test.py::test_users_xml_is_readonly 0.00s teardown test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1] 0.00s setup test_reloading_storage_configuration/test.py::test_remove_disk 0.00s setup test_row_policy/test.py::test_introspection 0.00s teardown test_session_log/test.py::test_grpc_session 0.00s setup test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config 0.00s setup test_row_policy/test.py::test_miscellaneous_engines 0.00s setup test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s setup test_reloading_storage_configuration/test.py::test_remove_policy 0.00s teardown test_storage_redis/test.py::test_delete 0.00s teardown test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage 0.00s teardown test_session_log/test.py::test_parallel_sessions 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 0.00s setup test_reloading_storage_configuration/test.py::test_new_policy_works 0.00s teardown test_storage_hudi/test.py::test_multiple_hudi_files 0.00s setup test_reloading_storage_configuration/test.py::test_add_volume_to_policy 0.00s teardown test_reloading_storage_configuration/test.py::test_add_disk 0.00s setup test_reloading_storage_configuration/test.py::test_remove_disk_from_policy 0.00s teardown test_reloading_storage_configuration/test.py::test_remove_policy 0.00s teardown test_settings_constraints_distributed/test.py::test_insert_clamps_settings 0.00s setup test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s teardown test_storage_redis/test.py::test_truncate 0.00s teardown test_reloading_storage_configuration/test.py::test_add_disk_to_policy 0.00s setup test_reloading_storage_configuration/test.py::test_add_policy 0.00s setup test_row_policy/test.py::test_row_policy_filter_with_subquery 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 0.00s setup test_row_policy/test.py::test_smoke 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_block_based_table_options 0.00s setup test_row_policy/test.py::test_dcl_management 0.00s teardown test_reloading_storage_configuration/test.py::test_add_policy 0.00s setup test_row_policy/test.py::test_tags_with_db_and_table_names 0.00s teardown test_reloading_storage_configuration/test.py::test_add_volume_to_policy 0.00s teardown test_storage_s3_queue/test.py::test_delete_after_processing[ordered] 0.00s teardown test_session_log/test.py::test_mysql_session 0.00s setup test_reloading_storage_configuration/test.py::test_remove_volume_from_policy 0.00s teardown test_rocksdb_options/test.py::test_invalid_options 0.00s teardown test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 0.00s setup test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml 0.00s setup test_rocksdb_options/test.py::test_table_valid_options 0.00s teardown test_reloading_storage_configuration/test.py::test_new_policy_works 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy 0.00s teardown test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch 0.00s setup test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data 0.00s teardown test_storage_hudi/test.py::test_types 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy 0.00s teardown test_storage_redis/test.py::test_simple_select 0.00s setup test_session_log/test.py::test_parallel_sessions 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_column_family_options 0.00s setup test_row_policy/test.py::test_reload_users_xml_by_timer 0.00s setup test_row_policy/test.py::test_policy_on_distributed_table_via_role 0.00s setup test_rocksdb_options/test.py::test_table_invalid_options 0.00s setup test_rocksdb_options/test.py::test_invalid_options 0.00s teardown test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s setup test_reloading_storage_configuration/test.py::test_add_disk_to_policy 0.00s teardown test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 0.00s setup test_row_policy/test.py::test_dcl_introspection 0.00s setup test_storage_redis/test.py::test_simple_select 0.00s teardown test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s teardown test_storage_s3_queue/test.py::test_max_set_size 0.00s teardown test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered] 0.00s teardown test_storage_s3_queue/test.py::test_failed_retry[ordered] 0.00s teardown test_storage_hudi/test.py::test_single_hudi_file 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s teardown test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list 0.00s teardown test_rocksdb_options/test.py::test_invalid_block_based_table_options 0.00s teardown test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered] 0.00s teardown test_storage_s3_queue/test.py::test_direct_select_file[ordered] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 0.00s setup test_storage_redis/test.py::test_simple_insert 0.00s setup test_rocksdb_options/test.py::test_invalid_column_family_options 0.00s setup test_reloading_storage_configuration/test.py::test_update_disk 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 0.00s teardown test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch 0.00s teardown test_storage_s3_queue/test.py::test_processed_file_setting[5] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 0.00s teardown test_storage_s3_queue/test.py::test_processed_file_setting[1] 0.00s teardown test_storage_s3_queue/test.py::test_failed_retry[unordered] 0.00s teardown test_storage_s3_queue/test.py::test_drop_table 0.00s teardown test_storage_redis/test.py::test_select_int 0.00s teardown test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 0.00s setup test_rocksdb_options/test.py::test_valid_column_family_options 0.00s setup test_storage_hudi/test.py::test_single_hudi_file 0.00s teardown test_storage_s3_queue/test.py::test_delete_after_processing[unordered] 0.00s setup test_rocksdb_options/test.py::test_valid_options 0.00s setup test_storage_s3_queue/test.py::test_delete_after_processing[unordered] 0.00s teardown test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 0.00s teardown test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 0.00s setup test_storage_s3_queue/test.py::test_max_set_size 0.00s teardown test_storage_s3_queue/test.py::test_direct_select_file[unordered] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 0.00s teardown test_storage_s3_queue/test.py::test_max_set_age 0.00s setup test_rocksdb_options/test.py::test_table_valid_column_family_options 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 0.00s teardown test_rocksdb_options/test.py::test_table_invalid_options 0.00s setup test_storage_s3_queue/test.py::test_drop_table 0.00s setup test_storage_s3_queue/test.py::test_processed_file_setting[5] 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 0.00s setup test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered] 0.00s setup test_storage_s3_queue/test.py::test_direct_select_file[ordered] 0.00s setup test_storage_s3_queue/test.py::test_max_set_age 0.00s setup test_storage_hudi/test.py::test_types 0.00s setup test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns 0.00s teardown test_rocksdb_options/test.py::test_valid_column_family_options 0.00s setup test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 0.00s setup test_storage_s3_queue/test.py::test_failed_retry[ordered] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 0.00s setup test_storage_s3_queue/test.py::test_processed_file_setting[1] 0.00s setup test_storage_s3_queue/test.py::test_direct_select_file[unordered] 0.00s setup test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered] 0.00s setup test_storage_s3_queue/test.py::test_failed_retry[unordered] 0.00s setup test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1] 0.00s setup test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch 0.00s setup test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered] 0.00s setup test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy 0.00s setup test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered] 0.00s teardown test_rocksdb_options/test.py::test_table_valid_options 0.00s teardown test_storage_redis/test.py::test_simple_insert =========================== short test summary info ============================ ERROR test_storage_hudi/test.py::test_multiple_hudi_files - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_storage_hudi/test.py::test_single_hudi_file - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_storage_hudi/test.py::test_types - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/.env', '--project-name', 'rootteststoragehudi', '--file', '/ClickHouse/tests/integration/test_storage_hudi/_instances_0/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', 'pull'] return non-zero code 1: Pulling proxy1 ... ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list ERROR test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy ERROR test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch ERROR test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns ERROR test_storage_s3_queue/test.py::test_delete_after_processing[ordered] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_delete_after_processing[unordered] ERROR test_storage_s3_queue/test.py::test_direct_select_file[ordered] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_direct_select_file[unordered] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered] ERROR test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered] ERROR test_storage_s3_queue/test.py::test_drop_table - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_failed_retry[ordered] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_failed_retry[unordered] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_max_set_age - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_max_set_size - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered] ERROR test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered] ERROR test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered] ERROR test_storage_s3_queue/test.py::test_processed_file_setting[1] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_processed_file_setting[5] - Exception: Command ['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/.env', '--project-name', 'rootteststorages3queue', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/instance2/docker-compose.yml', '--file', '/ClickHouse/tests/integration/test_storage_s3_queue/_instances_0/old_instance/docker-compose.yml', 'pull'] return non-zero code 1: Pulling zoo2 ... ERROR test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] ERROR test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format ERROR test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage ERROR test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl PASSED test_session_log/test.py::test_grpc_session PASSED test_session_log/test.py::test_mysql_session PASSED test_session_log/test.py::test_parallel_sessions PASSED test_reloading_storage_configuration/test.py::test_add_disk PASSED test_rocksdb_options/test.py::test_invalid_block_based_table_options PASSED test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with PASSED test_storage_redis/test.py::test_create_table PASSED test_session_log/test.py::test_postgres_session PASSED test_storage_redis/test.py::test_delete PASSED test_storage_redis/test.py::test_select_int PASSED test_storage_redis/test.py::test_simple_insert PASSED test_storage_redis/test.py::test_simple_select PASSED test_reloading_storage_configuration/test.py::test_add_disk_to_policy PASSED test_storage_redis/test.py::test_truncate PASSED test_storage_redis/test.py::test_update PASSED test_rocksdb_options/test.py::test_invalid_column_family_options PASSED test_row_policy/test.py::test_change_of_users_xml_changes_row_policies PASSED test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config PASSED test_reloading_storage_configuration/test.py::test_add_policy PASSED test_row_policy/test.py::test_dcl_introspection PASSED test_rocksdb_options/test.py::test_invalid_options PASSED test_reloading_storage_configuration/test.py::test_add_volume_to_policy PASSED test_reload_query_masking_rules/test.py::test_reload_query_masking_rules PASSED test_row_policy/test.py::test_dcl_management PASSED test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml PASSED test_reloading_storage_configuration/test.py::test_new_policy_works PASSED test_rocksdb_options/test.py::test_table_invalid_block_based_table_options PASSED test_row_policy/test.py::test_grant_create_row_policy PASSED test_reloading_storage_configuration/test.py::test_remove_disk PASSED test_row_policy/test.py::test_introspection PASSED test_row_policy/test.py::test_join PASSED test_rocksdb_options/test.py::test_table_invalid_column_family_options PASSED test_reloading_storage_configuration/test.py::test_remove_disk_from_policy PASSED test_row_policy/test.py::test_miscellaneous_engines PASSED test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned PASSED test_reloading_storage_configuration/test.py::test_remove_policy PASSED test_row_policy/test.py::test_policy_on_distributed_table_via_role PASSED test_reload_zookeeper/test.py::test_reload_zookeeper PASSED test_rocksdb_options/test.py::test_table_invalid_options PASSED test_rocksdb_options/test.py::test_table_valid_column_family_options PASSED test_rocksdb_options/test.py::test_table_valid_options PASSED test_rocksdb_options/test.py::test_valid_column_family_options PASSED test_reloading_storage_configuration/test.py::test_remove_volume_from_policy PASSED test_rocksdb_options/test.py::test_valid_options PASSED test_row_policy/test.py::test_reload_users_xml_by_timer PASSED test_reloading_storage_configuration/test.py::test_update_disk PASSED test_row_policy/test.py::test_row_policy_filter_with_subquery PASSED test_recovery_replica/test.py::test_update_metadata PASSED test_row_policy/test.py::test_smoke PASSED test_row_policy/test.py::test_some_users_without_policies PASSED test_row_policy/test.py::test_tags_with_db_and_table_names PASSED test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter PASSED test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter PASSED test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop PASSED test_replication_without_zookeeper/test.py::test_startup_without_zookeeper PASSED test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data PASSED test_replace_partition/test.py::test_normal_work PASSED test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data PASSED test_row_policy/test.py::test_users_xml_is_readonly PASSED test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings PASSED test_row_policy/test.py::test_with_prewhere PASSED test_settings_constraints_distributed/test.py::test_insert_clamps_settings PASSED test_settings_constraints_distributed/test.py::test_select_clamps_settings ================== 63 passed, 37 errors in 359.11s (0:05:59) =================== Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 437, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_asrp3k --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=2cffe1eae894 -e DOCKER_BASE_TAG=2993bc2bf171 -e DOCKER_KERBERIZED_HADOOP_TAG=ce74919e88f5 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=a2d3dc777d0c -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_recovery_replica/test.py::test_update_metadata test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_query_masking_rules/test.py::test_reload_query_masking_rules test_reload_zookeeper/test.py::test_reload_zookeeper test_reloading_storage_configuration/test.py::test_add_disk test_reloading_storage_configuration/test.py::test_add_disk_to_policy test_reloading_storage_configuration/test.py::test_add_disk_to_separate_config test_reloading_storage_configuration/test.py::test_add_policy test_reloading_storage_configuration/test.py::test_add_volume_to_policy test_reloading_storage_configuration/test.py::test_new_policy_works test_reloading_storage_configuration/test.py::test_remove_disk test_reloading_storage_configuration/test.py::test_remove_disk_from_policy test_reloading_storage_configuration/test.py::test_remove_policy test_reloading_storage_configuration/test.py::test_remove_volume_from_policy test_reloading_storage_configuration/test.py::test_update_disk 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replace_partition/test.py::test_normal_work test_replicated_merge_tree_config/test.py::test_replicated_merge_tree_settings test_replicated_merge_tree_replicated_db_ttl/test.py::test_replicated_db_and_ttl test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_after_fetch test_replicated_s3_zero_copy_drop_partition/test.py::test_drop_complex_columns test_replication_without_zookeeper/test.py::test_startup_without_zookeeper test_rocksdb_options/test.py::test_invalid_block_based_table_options test_rocksdb_options/test.py::test_invalid_column_family_options test_rocksdb_options/test.py::test_invalid_options test_rocksdb_options/test.py::test_table_invalid_block_based_table_options test_rocksdb_options/test.py::test_table_invalid_column_family_options test_rocksdb_options/test.py::test_table_invalid_options test_rocksdb_options/test.py::test_table_valid_column_family_options test_rocksdb_options/test.py::test_table_valid_options test_rocksdb_options/test.py::test_valid_column_family_options test_rocksdb_options/test.py::test_valid_options test_row_policy/test.py::test_cannot_trick_row_policy_with_keyword_with test_row_policy/test.py::test_change_of_users_xml_changes_row_policies test_row_policy/test.py::test_dcl_introspection test_row_policy/test.py::test_dcl_management test_row_policy/test.py::test_dcl_users_with_policies_from_users_xml test_row_policy/test.py::test_grant_create_row_policy test_row_policy/test.py::test_introspection test_row_policy/test.py::test_join test_row_policy/test.py::test_miscellaneous_engines test_row_policy/test.py::test_policy_from_users_xml_affects_only_user_assigned test_row_policy/test.py::test_policy_on_distributed_table_via_role test_row_policy/test.py::test_reload_users_xml_by_timer test_row_policy/test.py::test_row_policy_filter_with_subquery test_row_policy/test.py::test_smoke test_row_policy/test.py::test_some_users_without_policies test_row_policy/test.py::test_tags_with_db_and_table_names test_row_policy/test.py::test_throwif_error_in_prewhere_with_same_condition_as_filter test_row_policy/test.py::test_throwif_error_in_where_with_same_condition_as_filter test_row_policy/test.py::test_throwif_in_prewhere_doesnt_expose_restricted_data test_row_policy/test.py::test_throwif_in_where_doesnt_expose_restricted_data test_row_policy/test.py::test_users_xml_is_readonly test_row_policy/test.py::test_with_prewhere test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_env_proxy test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_proxy_list test_s3_table_function_with_https_proxy/test.py::test_s3_with_https_remote_proxy test_s3_zero_copy_ttl/test_vertical_merge_memory_usage.py::test_vertical_merge_memory_usage test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session test_session_log/test.py::test_parallel_sessions test_session_log/test.py::test_postgres_session test_settings_constraints_distributed/test.py::test_insert_clamps_settings test_settings_constraints_distributed/test.py::test_select_clamps_settings test_storage_hudi/test.py::test_multiple_hudi_files test_storage_hudi/test.py::test_single_hudi_file test_storage_hudi/test.py::test_types test_storage_redis/test.py::test_create_table test_storage_redis/test.py::test_delete test_storage_redis/test.py::test_select_int test_storage_redis/test.py::test_simple_insert test_storage_redis/test.py::test_simple_select test_storage_redis/test.py::test_truncate test_storage_redis/test.py::test_update 'test_storage_s3_queue/test.py::test_delete_after_processing[ordered]' 'test_storage_s3_queue/test.py::test_delete_after_processing[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_file[unordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[ordered]' 'test_storage_s3_queue/test.py::test_direct_select_multiple_files[unordered]' test_storage_s3_queue/test.py::test_drop_table 'test_storage_s3_queue/test.py::test_failed_retry[ordered]' 'test_storage_s3_queue/test.py::test_failed_retry[unordered]' test_storage_s3_queue/test.py::test_max_set_age test_storage_s3_queue/test.py::test_max_set_size test_storage_s3_queue/test.py::test_multiple_tables_meta_mismatch 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync[unordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[ordered]' 'test_storage_s3_queue/test.py::test_multiple_tables_streaming_sync_distributed[unordered]' 'test_storage_s3_queue/test.py::test_processed_file_setting[1]' 'test_storage_s3_queue/test.py::test_processed_file_setting[5]' 'test_storage_s3_queue/test.py::test_processed_file_setting_distributed[1]' -vvv" altinityinfra/integration-tests-runner:9d492c2eec24 ' returned non-zero exit status 1.